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Abstract —The online algorithm design was proposed to handle 
the caching problem when the futnre information is unknown 
f31. And currently, it draws more and more attentions from the 
researchers from the areas of microgrid, where the production 
of renewables are unpredictable, (Si, |4|, etc. 

In this note, we present a framework of randomized online 
algorithm design for the simple and tractable problem. This 
framework hopes to provide a tractable design to design a 
randomized online algorithm, which can be proved to achieve 
the best competitive ratio by Yao’s Principle (Q. 

l. A SIMPLE BUT GENERAL PROBLEM REQUIRING ONLINE 

SOLUTION 

In this note, we consider a simple problem, which needs 
to be solved in the online manner. Suppose its input can be 
denoted by the parameter p € V and its online algorithm can 
be denoted by s e 5. For example, in the ski rental problem 

m, US, p represents how many times the player goes to ski 
totally, and s represents how many days the player rents the 
ski before he buys the ski. In our consideration, p and s can 
be numbers, vectors or matrixes. Q We use the probability 
distributions of p and s to denote the randomized input and 
the randomized online algorithm. 

Obviously the optimal offline cost is uniquely determined by 
the input p, which we denote as Costoff(p), while the online 
cost is jointly determined by the input p and the algorithm s, 
which we denote as Coston{s,p). 

The ratio of the online cost and offline cost R{s,p) = 
'"°CosUf’^^ evaluates how well the online algorithm s performs 
on the input p: a smaller R{s,p) means better s, and R{s^) > 
1. We assume we can obtain a closed form of i?(s,p).13 

II. A Lower Bound for the Competitive Ratio by 
Yao’s Principle 

For a given randomized online algorithm A^, we can obtain 
its competitive ratio by CR(Ar) = max,>,pt,f cosw ' show 
that this randomized online algorithm is the best in terms of 
competitive ratio, technically, we need to show that given any 
other randomized online algorithm, the competitive ratio is 
larger. This is nontrivial because it is difficult to enumerate all 
possible randomized online algorithms in the design space, or 
we can think that it’s difficult to enumerate all distributions. 

'The problem should be simple enough such that we can characterize its 
input and its online algorithm by a limited number of parameters. 

^Again, since the problem is so simple 


In the following analysis, we denote the randomized online 
algorithm and the randomized input by two randomized vari¬ 
ables S with the distribution f{s) and P with the distribution 
g{p), which are supported by S and V respectively. 

For convenience, we define two functions Ug{s) and Vf{p) 
as follows, 

• Given the randomized input g{p), Ug{s) represents the 
expectation of the ratio when the online algorithm is 
deterministically s, i.e. 



C0StQn(5, p) 

Costoff(p) 


g{p)dp. 


• Given the randomized online algorithm /(s), V/(p) rep¬ 
resents the expectation of the ratio when the input is 
deterministically p, i.e. 



CoSton(5, p) 

Costoff(p) 


f{s)ds. 


A. Yao’s Principle 

We have Yao’s Principle Ih) to obtain a lower bound of the 
competitive ratio. 

Lemma 1 (Yao’s Principle): The competitive ratio of any 
randomized online algorithm is lower bounded by the ratio 
of any randomized input and the best deterministic online 
algorithm, i.e. 


max min t/„(s) < minmaxlA(p) 
a { p ) ® /(s) P 

Imagine that we can design an online algorithm with the 
competitive ratio R, which means that R is an upper bound 
for CR and we can also find a random input, the best 
deterministic online algorithm for which is also R, which 
means that R is a lower bound for CR, we can say that 
our randomized online algorithm can achieve the smallest 
competitive ratio,thus optimal in terms of CR. 


B. By min max inequality 

In fact, the Yao’s Principle can be viewed as a special case 
of the more general min max inequality GE 

maxmin p) < minmax/i(a:, p). 

y X X y 


^This inequality is so general that h{x,y) can be any real-valued function 
and that there is no requirement for the function h (say, whether convex 
or continuous) and the feasible regions of x and y (say, whether convex or 
compact). 






Please be noted that the equality does not always hold. If 
maxy minj; h{x, y) = minj; maxy y), we say that h(x, y) 
and the feasible regions of x, y satisfy the strong max-min 
property(or the saddle-point property). 

Here we define a function H{f,g) = 
J R{s,p)f{s)g{p)dpds, where R{s,p) = and 

the variables /, g are the distributions we define in the 
previous part. We assume the function R{s,p)f{s)g{p) 
satisfies the condition of Fubini Theorem, meaning we can 
compute H{f,g) by iterated integrals and we can change the 
order of the integration. 0 As a result, we can have 


1) Two lemmas: Sufficient Condition: 

Lemma 2: Suppose there exist a randomized online algo¬ 
rithm /(s) and a randomized input g{p), such that V^{p) = C 2 
and Ug{s) = Ci, where Ci and C 2 are constants, we can have 
Cl = C 2 . As a result, /(s) is the best randomized online 
algorithm. 

Proof: Let’s consider the value 

n= f f R{s,p)f{s)g{p)dpds. 

J S J p 

If we calculate TZ by firstly doing integral on P, we can have 


H{f,g) = j Ug{s)f{s)ds = j Vf{p)g{p)dp. 

By min max inequality, we can have 

maxg(p)mm/(s) < mm/(s) maxy(p) 7L(/, p). 

Furthermore, note that 


^ = / Ug{s)f{s)ds 
J S 

= Cv, 

otherwise, we will have 


I min/(s) H{f,g) = min^ Ug{s), \/g{p) 

\maxg(p) H{f,g) = u\&y.pVf{p), 

Then we can establish the inequality in Yao’s Principle. 

Remark: note that, by Yao’s Principle, we can easily have a 
lower bound once we choose a randomized input, but we don’t 
how tight the lower bound is. It seems we need to randomly 
pick a randomized input to obtain a lower bound and randomly 
pick a randomized algorithm to obtain an upper bound, and 
we are happy only when we are lucky to make them equal to 
each other. But this ’trial and error’ is not good for at least 
two reasons, 

• We don’t know whether the desired randomized input 
and algorithm exist or not. Maybe the randomized input 
and algorithm actually don’t exist(the equality in Yao’s 
Principle never happens for the specific problem we 
study), then we spend our whole life on trial and error, 
unhappily. Question One: under what condition is the 
Yao’s Principle powerful enough to verify the optimality 
of the randomized online algorithm? 

■ If we just randomly pick the randomized input and 
algorithms, we need to wait for quite a long time to 
be happy since the design space is so large. In other 
words, Yao’s Principle does not provide a guideline to 
find the optimal distributions. Question Two: given that 
the equality in Yao’s Principle holds, how can we find 
the optimally randomized online algorithm /*(s) and 
randomized input g*{p). 

The remaining part of this note focus on tackling the above 
two problems. We firstly give a guideline for searching the 
randomized input and algorithm with the assumption that they 
do exist; and then we study the existence problem. 

C. A Sufficient and Necessary Condition 

In this part we try to obtain a sufficient and necessary 
condition for the best randomized online algorithm, under 
the condition that there does exist such randomized online 
algorithm whose optimality can be justified by Yao’s Principle. 

'^This requirement is thought to be general 


^ = / Vf{p)g{p)ds 
Jp 
= C2. 


Then Ci = C 2 and the proof is complete. 


Necessary Condition: 

Lemma 3: Suppose there exist a randomized algorithm 
/*(s) and a randomized input g*{p), such that 

min Ug* (s) = max FT. (p), 

which means that the optimality of f*{s) can be justified by 
Lemma [T] then we can have {7g*(si) = C/g*(s 2 ) for any 
si,S 2 G {s|/*(s) > 0} and V/.(pi) = Vf^{p 2 ) for any 
Pi,P2 G {p\g*ip) > 0}. 

Proof: Let 

/ / R{s,p)f*{s)g*(p)dpds 

J S J p 

= [ Ug.is)ns)ds 

J s 

= [ yp{p)9*{p)dp. 

Jp 

and we can have min^ Ug* (s) <TZ < maxp Vf (p). Then the 
following equality automatically holds. 


minl7„. (s) = 7^ = maxyf.(p). (1) 

S p 

For any si,S 2 G {s\f*{s) > 0}, if Ug*{si) < C/g*(s 2 ), we 
can have 

mmC/g.(s) < J t/g. (s)/*(s)ds 
= 7^, 

which is a contradiction with Eq [1] then we can have 
t/g.(si) = Ug*{s 2 ) for any si,S 2 G {s|/*(s) > 0}. The 
remaining similar result can also be proved in the same way. 



2) One guideline: Once we have Lemma ??, we can 
immediate come up with the guideline for Question Two, as 
follows. 


f*(s) Optimal Randomized algorithm: Set Vf{p) = C, i.e. 


dVfjp) 

dp 


= 0 and with 


/(s) > 0 


to derive /*(s). 


0 


J f{s)ds = 1 

g*(p) Optimal Randomized input: Set Ug{s) = C, i.e. = 

to derive g*{p). 


0 and with 


\l 9{p)dp = 1 


Remark 1: We remark that the two lemmas can be used to 
check whether the equality in Yao’s Principle holds or not. 

Remark 2: Actually, with the assumption that the equality 
in Yao’s Principle holds, it seems that if we can find a 
randomized algorithm to achieve a constant ratio for any input, 
we can say that the algorithm is optima^; but it seems equally 
difficult to verify that ‘the equality in Yao’s Principle holds’ 
without checking the previous two lemmas. 

Remark 3: The result in this part already gives us enough 
motivation, in the process of designing a randomized online 
algorithm, to find /*(s) to make V/. (p) being constant for any 
input p, and also g*{p). However, it does not guarantee that 
we could find such distributions. Again, note that the analysis 
in this subsection is made under the condition that there does 
exist such randomized online algorithm whose optimality can 
be justified by Yao’s Principle for the given problem. In other 
words. Question One still has no answer. 


III. A Sufficient and Necessary Condition for a 
Tight Lower Bound 

In this section, we want to explore under which condition 
the lower bound by Yao’s Principle is tight. As explained 
above, the lower bound being tight is equivalent to that the 
strong min max property holds for the inequality 

maxminiL(/, p) < minmaxiL(/, p). 

S(p) fO) f{s) g{p) 

More specifically, let us firstly define a saddle point for the 
function H{f,g) as 

if*= argmin/(^) iL(/,5*) 

\g* = argmaxg(p) H{f*,g), 

and we further have Lemma |4] 

Lemma 4: The lower bound by Yao’s Principle is tight if 
and only if there exists a saddle point (/*, p*) for the function 
Hif,g). 

With this lemma, it remains to determine under which 
condition the function H (/, g) has a saddle point. But the 
existence of saddle point can be equally difficult to check. 

^The math is relative basic but the calculation can be quite intensive 

®this seems reasonable for the author, but this assertion is so strong that 
we don’t treat it as a lemma cun'ently, to avoid possible confusion 


A. On the Existence of Saddle Point 

1) Some Mathematical Theorems: We review the classic 
theorems for the existence of a saddle point as follows. 

Theorem 1 (Kneser Theorem): Let X be a nonempty con¬ 
vex subsect in a Plausdorjf topological vector space E and 
Y a nonempty compact and convex subset of a Plausdorjf 
topological vector space F. Let / be a real valued function 
defined on X xY. If (1) the function x f{x, y) is concave 
on X, (2) the function y f{x,y) is lower semicontinuous 
and convex on Y, then 

min sup f(x, y) = sup min/(a:, y). 
xex 

Theorem 2 (Von Neumann Theorem): Let X and Y be 
nonempty compact and convex subsets in a Plausdorjf locally 
convex vector spaces E and F respectively and / a real 
valued function defined on AT x y. Suppose (1) the function 
X f{x,y) is lower semicontinuous and quasiconvex on X, 
(2) the function y f{x,y) is upper semicontinuous and 
quasiconcave on Y. Then, / has a saddle point. 

A theorem for the more general cases. 

Theorem 3 (General Theorem): Let M and N be any 
spaces, / a function on M x N that is concave-convex like. 
If for any c < inf sup / there exists a finite subset X C M 
such that for any i/ G N there is an a; G AT with f(x, v) > c, 
then sup inf / = inf sup / 

2) Results with Compact Feasible Regions S and V: Let 
us firstly make another assumption that the feasible regions 
for the deterministic online algorithm and input are compact 
(bounded and closed). For example, S and V are compact 
subspaces of the Euclidian space (recall that s and p can be 
vectors or matrix). We provide the following well-established 
theorem to show the existence of the saddle point. 

Theorem 4 (Glicksberg’s theorem): If A and B are com¬ 
pact sets, and K is an upper semicontinuous or lower semi¬ 
continuous function on A x B, then 

sup inf J J Kdf dg = ini sup J J Kdfdg, 

where / and g run over Borel probability measures on A and 

B. 

In Glicksberg’s Theorem, even though we say A and B are 
subspaces of Euclidian space, the variables, / and g, of the 
function K do not necessarily lies in the Euclidian Space, 
just thinking about the probability density distribution of a 
continuous random variable. 

Moreover, in my mind, this theorem can be viewed as a 
generalization of the Nash Equilibrium theorem and a special 
case of the Debreu- Glicksberg-Fan Theorem. 

B. Remark 

As we can see, it is not easy for the strong min max 
inequality to hold. So we are not so confident that the 
optimality of the randomized online algorithm can always be 
proved by Yao’s Principle (suppose the convexity, continuity, 
compactness conditions are not satisfied). 




IV. Generalization 


In this part, we try to generalize the above result to 
the more complex scenarios, in which the algorithm is so 
complicated that it can not simply represented by single or 
several variables. 

To make our life easier (easy to use the well established 
results, especially Glicksberg’s Theorem), we make two as¬ 
sumptions as follows. 

1 

1) The input belongs to a Banach Space. For a input vector 
u indicating a demand sequence, its norm is defined 
as the optimal offline cost to satisfy the demand, i.e., 
norm(u) = Costoff(u). 

2) The online algorithm also belongs to a Banach Space. 
We represent one online algorithm as a function / from 
the space of input to M+, and the value of the function 
is defined as the online cost given the input u, i.e., 
f{u) = Costoff(tt). The norm of the function is defined 
as norm( f) = sup,, \ 

\j ) t'u norm(zf) 

V. Not the End 

If the above definition is valid (the definition of space and 
norm need to verify.), the optimal online algorithm can be 
derived under the framework of this note and its optimality 
can also be prove if the condition of Glicksberg’s Theorem is 
satisfied. 

Then we make a conjecture as follows. 

Conjecture: There exist some problems, the opti¬ 
mality of whose online algorithm cannot be proved 
by Yao’s Principle. 
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